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Eight pigeons responded in a three-component concurrent-chains procedure, with either independent 
or dependent initial links. Relative probability and immediacy of reinforcement in the terminal links 
were both varied, and outcomes on individual trials (reinforcement or nonreinforcement) were either 
signaled or unsignaled. Terminal-link fixed-time schedules were varied across components within 
conditions to yield immediacy ratios of 1:2, 1:1 and 2:1. The probabilities of reinforcement were varied 
across conditions to yield reinforcer ratios of 1:5, 1:2, 2:1 and 5:1. Results showed that a model based on 
the generalized matching law provided a good description of response allocation, accounting for 92% 
of the variance overall. As expected, sensitivity to probability was greater in the unsignaled conditions. 
However, sensitivity to immediacy was also greater in the unsignaled conditions, suggesting that the 
effect of signaling terminal-link outcomes may not be limited to probability but apply to reinforcer 
variables in general. The effects of signaling can be explained in terms of conditioned reinforcement 
added to each alternative’s outcomes in the matching law. There was some evidence for an interaction 
between reinforcer probability and immediacy, particularly for the dependent-schedules group, such 
that sensitivity to immediacy was greater at moderate rather than extreme reinforcer ratios. However, 
further analysis suggested that this could have been due to a ceiling effect on response allocation 
imposed by dependent scheduling. Overall, the present results show that the generalized matching law 
can provide a useful account of choice between outcomes that vary in both probability and immediacy 
of reinforcement. 

Key words: concurrent chains, reinforcer probability, reinforcer immediacy, signaled reinforcement, 
key peck, pigeons 


Choice has been a major topic of research 
since Herrnstein’s (1961) report of matching 
of response allocation to relative reinforcer 
rate in concurrent variable-interval (VI) VI 
schedules. Early studies extended the match- 
ing relation in concurrent schedules to other 
dimensions of reinforcement. For example, 
Catania (1963) reported that relative response 
rate approximately matched relative reinforcer 
magnitude, and Chung and Herrnstein (1967) 
reported matching to relative reinforcer im- 
mediacy (i.e., the reciprocal of delay). An 
extended matching law framework, first pro- 
posed by Baum and Rachlin (1969; see also 
Baum, 1974), combines reinforcer variables 
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muldplicadvely to define relative reinforcer 
“value”: 
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According to Equation 1, the concatenated 
matching law, response allocation matches the 
relative value of the choice alternatives, with 
value determined by several different reinforc- 
er dimensions. In Equation 1, il is response 
rate, R is reinforcer rate, D is reinforcer delay, 
M is reinforcer magnitude, and Vis reinforcer 
value, subscripted for Choice Alternatives 1 
and 2. There are four parameters: c, which 
represents bias, and a sensitivity exponent for 
each reinforcer dimension (a^ %,> and «m)- 

Elerrnstein (1964) investigated the adequacy 
of the matching relation for responding 
maintained by conditioned rather than prima- 
ry reinforcement, using the concurrent-chains 
procedure introduced by Autor (1960/1969). 
The concurrent-chains procedure is a similar 
experimental arrangement to concurrent 
schedules in that two or more schedules of 
reinforcement are presented simultaneously 
to the subject on different response keys. 
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Responses during the choice phase or initial 
link are reinforced hy a change in color of the 
key light and hy allowing access to one of two 
mutually exclusive terminal links. Once a 
terminal link has heen entered, the other key 
becomes dark and inoperative. Responses 
during a terminal link produce access to food 
according to a separate reinforcement sched- 
ule. Thus, the concurrent-chains procedure 
allows various dimensions of reinforcement 
(such as immediacy, magnitude or prohahility) 
to be manipulated in the terminal links, and 
the effects of these dimensions on choice to be 
studied using responding in the initial links. 

Although Herrnstein’s initial application of 
the matching law to concurrent chains was 
encouraging, it was discovered that relative 
response rate deviated from relative delay of 
reinforcement when the overall durations of 
either the terminal links or the initial links 
were varied (Davison 1983; Fantino, 1969). 
This result violates the assumption, implicit in 
Equation 1, that preference depends on 
relative, not absolute, values of reinforcement 
variables. Subsequently, Grace (1994) pro- 
posed an alternative model, still based on the 
matching law, which attempted to resolve this 
failure of the “relativity” assumption. The 
novel feature of Grace’s model is that variables 
relating to the conditions in the terminal link 
(reinforcer immediacy and magnitude ratios 
in Equation 1 ) are raised to the power Tt / T^, 
which is the ratio of the average terminal- and 
initial-link durations. This exponent captures 
the dependence of sensitivity to immediacy 
and magnitude {ud and «m) on temporal 
context (i.e., the durations of initial and 
terminal links). In conditions where T^ = T^, 
as in the experiments described below, Grace’s 
model and Equation 1 are equivalent. 

One of the most important assumptions of 
Equation 1 is that the effects on preference of 
different variables such as reinforcer rate, 
immediacy and magnitude, are independent 
and combine multiplicatively (additively in 
logarithmic form). This assumption has been 
tested in a variety of studies that have 
manipulated various combinations of these 
variables parametrically (e.g., Grace, 1995; 
Grace, Bedell, & Nevin, 2002; McLean & 
Blampied, 2001), and the general conclusion 
is that independence has been supported 
when relative, but not absolute, levels of 
reinforcer variables have been manipulated 


(Berg & Grace, 2004; but cf. Elliffe, Davison, & 
Landon, 2008) . However, one variable that has 
not received much attention in these paramet- 
ric studies is reinforcer probability. Although it 
is well established that pigeons’ choice in 
concurrent chains favors the alternative that 
delivers food with higher probability (e.g., 
Spetch & Dunn, 1987), research has not yet 
varied reinforcer probability parametrically in 
combination with other reinforcer variables. 
Such a study would provide a test of whether 
the effects of reinforcer probability are inde- 
pendent of, and combine additively with, 
other reinforcer variables. 

An important factor in probabilistic rein- 
forcement procedures is the degree to which 
terminal-link stimuli are correlated with the 
outcomes scheduled on individual trials. Dis- 
tinctive stimuli may be associated with the 
scheduled outcome (reinforcement or nonre- 
inforcement) on individual trials (signakd), or 
the same stimulus may be presented whether 
or not reinforcement is forthcoming {un- 
signaled). With unsignaled terminal links, the 
typical result is that response allocation in the 
initial links strongly favors the alternative on 
which terminal-link reinforcement is more 
likely (e.g., Kendall, 1974, 1985; Spetch & 
Dunn, 1987). With signaled terminal links, 
preference for the more reliable alternative is 
much reduced (e.g., Dunn & Spetch, 1990; 
Kendall, 1974, 1985). This attenuation in 
preference with signaling implies a reduction 
in sensitivity to reinforcer probability, known 
as the signaling effect. Because no prior studies 
have examined the effects of probability in 
combination with other reinforcer variables, it 
is unknown whether the signaling of outcomes 
affects only sensitivity to probability; it might 
also affect sensitivity to other reinforcer 
variables. 

The aim of the present research was to 
investigate whether effects of reinforcer prob- 
ability and immediacy on choice are additive 
and independent, for both signaled and 
unsignaled probabilistic reinforcement proce- 
dures. By varying immediacy and probability 
across series of signaled and unsignaled 
conditions, we planned to test whether signal- 
ing terminal-link reinforcer outcomes affected 
sensitivity to immediacy as well as probability. 
We used a multiple concurrent-chains proce- 
dure similar to that employed by Grace (1995) 
and Grace et al. (2002). Three different 
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concurrent-chains schedules were presented, 
in separate components, during each session. 
Components were distinguished by the color 
(red, white or green) of both response keys 
during the initial links and of the operative key 
in the terminal link. Relative immediacy of 
reinforcement was varied across components; 
1:2 in the red component, 1:1 in the white 
component and 2:1 in the green component. 
Relative reinforcer probability in the terminal 
links was constant across components, and was 
varied across conditions (5:1, 1:5, 2:1, and 1:2). 
The VI schedules used in the initial links were 
constant across components and conditions. 
These conditions were conducted twice; once 
with the terminal-link outcomes (i.e., rein- 
forcement or nonreinforcement) signaled, 
and once with them unsignaled. Thus, the 
experimental design allowed us to examine 
the effects of parametric variation in relative 
reinforcer probability at different levels of 
relative immediacy, for both signaled and 
unsignaled terminal links. Our primary goals 
were to characterize the effects of reinforcer 
probability and immediacy on choice and to 
test if they were additive and independent, as 
required by the matching law, and whether 
signaling terminal-link outcomes would re- 
duce sensitivity to probability. 

METHOD 

Subjects 

Eight mixed-breed pigeons, numbered 161 
through 164 and 185 through 188, served as 
subjects. They were maintained at 85% of free- 
feeding body weights (± 15g) by postsession 
feeding of mixed grain when necessary. They 
were housed individually in a vivarium with a 
12:12 hr light/dark cycle (lights on at 0700h), 
and with free access to grit and water. All had 
previous experience with a variety of experi- 
mental procedures. 

Apparatus 

Eight standard three-key operant chambers 
were used, measuring 350 mm deep by 360 mm 
wide by 350 mm high. The 20-mm diameter 
response keys were located 260 mm above the 
floor and arranged in a row, 100 mm apart. A 
houselight was located 70 mm above the 
center key and a grain magazine with an 
aperture of 60 mm by 50 mm was located 


130 mm below the center key. The grain 
magazine was illuminated when reinforcement 
(wheat) was made available. A force of 
approximately 0.1 N was required to operate 
each response key, and effective responses 
produced an audible feedback click. Each 
chamber was enclosed in a sound-attenuating 
box, and ventilation and masking noise were 
provided by an attached fan. The experiment 
was controlled and data collected using a 
MEDSTATE® notation program and a MED- 
PC® system interfaced to a microcomputer 
located in an adjacent room. 

Procedure 

Because all subjects had previous experience 
in a variety of procedures, training began 
immediately in the first condition. Sessions 
were conducted daily at the same time (llOOh 
and 1200h) with few exceptions. A three- 
component multiple concurrent-chains proce- 
dure was employed. Components were differ- 
entiated by the color of keylights (red, white or 
green) used for all stimuli in a trial. Compo- 
nents consisted of 24 concurrent-chains trials, 
presented in a block. Components were 
separated by a 3-min blackout and the order 
of presentation was randomized before each 
session. The houselight provided general 
illumination except when reinforcement was 
being delivered, during intercomponent 
blackouts, and during no-food terminal links 
in the signaled conditions (see below). 

Concurrent chains. To extend the generality 
of our results we divided subjects into two 
groups of 4, one trained with independent 
scheduling in the initial links and the other 
with dependent scheduling. For both groups, 
trials began with the side keys illuminated with 
the color associated with the current compo- 
nent, signifying the initial link or choice phase 
of the procedure. For the group receiving 
dependent scheduling, terminal-link entry was 
randomly assigned to either the left or the 
right key on each trial (Stubbs & Pliskoff, 
1969), with the restriction that three out of 
every six cycles were assigned to each key. An 
interval was sampled randomly without re- 
placement from a list associated with the 
assigned key at the start of a trial. Separate 
lists were maintained for cycles in which entry 
into the left and right terminal links was 
arranged so that each interval was used equally 
often on left- and right-assigned trials. The 
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intervals constituting the VI 15-s schedules 
contained the first 12 intervals from an 
arithmetic progression, a, 3a 5a, in which 
a equals one twelfth of the schedule value. The 
initial-link VI timer began timing after the first 
response to either key. There was no change- 
over delay. When the selected interval of the 
VI schedule had timed out, the next response 
to the assigned key resulted in terminal-link 
entry. For the second group of subjects, 
independent concurrent VI 30-s VI 30-s sched- 
ules operated during the initial links. Because 
both the left- and right-key intervals elapsed 
during initial links, the expected duration of 
initial links was the same as in the dependent- 
scheduling arrangement (15 s). These sched- 
ules also were composed of 12 intervals 
constructed from the same arithmetic progres- 
sion and were sampled without replacement. 
At the start of a component, intervals were 
sampled from both schedules; thereafter, an 
interval was sampled when terminal-link entry 
was gained for a particular alternative. As 
above, both schedules began timing in a cycle 
after the first response to either key and there 
was no changeover delay. The first response to 
a key after its schedule had timed out 
produced entry into the corresponding termi- 
nal link. When either terminal link was 
entered, timing for both initial-link schedules 
stopped. 

For both groups of subjects, terminal-link 
entry was accompanied by a change from 
constant to flashing illumination on the 
relevant key (i.e., 0.25 s off, 0.25 s on). The 
other key was darkened and responses to it 
had no scheduled consequence. Terminal 
links provided access to grain, or a blackout 
of equivalent duration, independently of 
responding and after a delay determined by a 
fixed-time (FT) schedule. Whether reinforce- 
ment or blackout occurred at the end of the 
delay was determined probabilistically (see 
below). During reinforcement, tbe grain mag- 
azine was raised and illuminated for 3 s. 

Different pairs of terminal-link schedules 
were used for the left and right alternatives in 
each component: FT 10 s (left) and FT 20 s 
(right) in the red component, FT 15 s and FT 
15 s in the white component, FT 20 s and FT 
10 s in the green component. Thus, immedi- 
acy ratios were 2:1, 1:1, and 1:2 in the red, 
white, and green components respectively. 
These schedules remained unchanged through- 


out the experiment. The same pair of 
reinforcer probabilities was used across com- 
ponents in eacb condition. Probability pairs 
in four conditions were .67 (left) and .33 
(right), .33 and .67, .83 and .17, or .17 and 
.83; corresponding to probability ratios of 
2:1, 1:2, 5:1, and 1:5. Probabilities were 
implemented by selecting from a list without 
replacement such that out of every 12 
terminal links, reinforcement would be deliv- 
ered 10 times (and blackout would occur 
twice) when the probability was .83, 8 times 
(with 4 blackouts) when it was .67, 4 times 
(with 8 blackouts) wben it was .33, and 2 
times (with 10 blackouts) wben it was .17. 
The four probability ratios were used in 
different conditions. 

Table 1 lists the conditions, including the 
reinforcer probabilities for left- and right-key 
terminal links, and whether or not the 
reinforcement outcome (reinforcement or 
nonreinforcement) was signaled during the 
terminal links. In both signaled and un- 
signaled conditions, the keylight stimulus 
(flashing color) was the same for each occur- 
rence of a particular terminal link, regardless 
whether food or blackout occurred on that 
trial. However, in the signaled conditions, a 
flashing houselight (0.25 s on, 0.25 s off) 
accompanied each terminal link that ended in 
blackout. In these conditions, the houselight 
flashed in phase with the flashing keylight. In 
unsignaled conditions, the houselight was 
illuminated continuously during terminal 
links. 

The order of conditions was counterbal- 
anced across subjects. Tbus, each subject 
began the experiment in a condition associat- 
ed with a different probability ratio. Half the 
subjects experienced the four signaled condi- 
tions first and the other half experienced the 
four unsignaled conditions first. Training in 
each condition continued for between 39 and 
45 sessions. Table 1 gives the positions of 
Conditions 1 through 8 in each subject’s 
sequence of conditions, along with the num- 
ber of training sessions given. A formal stability 
criterion was not employed because in prior 
studies using multiple concurrent chains, this 
amount of training was sufficient for response 
allocation to stabilize. However, after complet- 
ing the experiment we applied a commonly 
used stability criterion retrospectively to initial- 
link response allocation in each condition (see 
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Table 1 

Reinforcer probabilities for the left and right keys, and the presence or absence of signaling in 
each condition of the experiment. 


Reinforcer 

probabilities Dependent scheduling group Independent scheduling group 


Condition 

Signal 

Left Key 

Right key 

161 

162 

163 

164 

185 

186 

187 

188 

1 

present 

0.67 

0..33 

1 (.39) 

6 (39) 

3 (39) 

8 (39) 

1 (40) 

6 (40) 

3 (40) 

8 (40) 

2 

present 

0.33 

0.67 

2 (40) 

5 (40) 

4 (40) 

7 (40) 

2 (45) 

5 (45) 

4 (45) 

7 (45) 

3 

present 

0.83 

0.17 

3 (40) 

8 (40) 

1 (40) 

6 (40) 

3 (41) 

8 (41) 

1 (41) 

6 (41) 

4 

present 

0.17 

0.83 

4 (40) 

7 (40) 

2 (40) 

5 (40) 

4 (41) 

7 (41) 

2 (41) 

5 (41) 

5 

absent 

0.67 

0.33 

5 (40) 

2 (40) 

7 (40) 

4 (40) 

5 (41) 

2 (41) 

7 (41) 

4 (41) 

6 

absent 

0.33 

0.67 

6 (40) 

1 (40) 

8 (40) 

3 (40) 

6 (41) 

1 (41) 

8 (41) 

3 (41) 

7 

absent 

0.83 

0.17 

7 (40) 

4 (40) 

.5 (40) 

2 (40) 

7 (40) 

4 (40) 

5 (40) 

2 (40) 

8 

absent 

0.17 

0.83 

8 (40) 

3 (40) 

6 (40) 

1 (40) 

8 (40) 

3 (40) 

6 (40) 

1 (40) 


Note. The position of each condition in subjects’ sequences of conditions is given for Pigeons 161 through 164 in the 
dependent scheduling group and for Pigeons 185 through 188 in the independent scheduling group, with the number of 
sessions of training in parentheses. The listed reinforcer probabilities for left and right keys were used in all three 
components in each condition. 


below). We concluded that trends at the end 
of training were rare, and that where they 
existed they did not undermine our major 
conclusions. 

All significance tests used the .05 level. 
RESULTS 

The numbers of responses, terminal-link 
entries, and reinforcers were aggregated over 
the last 10 sessions for each component in 
each condition. The raw data are given in the 
Appendix, and were used in all subsequent 
data analysis. Log initial-link response ratios 
(left/ right) were analyzed using the following 
logarithmic form of the generalized matching 
law, which includes a term for relative rein- 
forcer probability (P) : 

log|l = log. + «.log(|) 

+ «,log(h) 

For subjects in the dependent-scheduling 
group the two terminal links were entered 
equally often, with few and minor exceptions 
(see Appendix), and so log(Pi/P 2 ) in Equa- 
tion 2 was assumed to be 0. 

Sensitivity to Relative Probability of Reinforcement 

Figures 1 and 2 show data from individual 
subjects in the dependent-scheduling group. 
Pigeons 161 through 164, in the unsignaled 


and signaled conditions respectively. Figure 1 
shows the base-10 logarithms of initial-link 
response ratios (left key/ right key) as a 
function of log reinforcer probability ratios, 
in the unsignaled conditions, for the 4 
subjects. Data from the three components 
are shown by different symbols, and the 
equations of least-squares regression lines 
fitted to each component’s data are given in 
the figure. As is evident in Figure 1, all subjects 
showed high levels of sensitivity to relative 
reinforcer probability (high regression slopes) 
in each component when the terminal links 
were unsignaled. Individual sensitivity values, 
averaged across components, were 1.75, 2.19, 
2.46 and 1.70, for Pigeons 161, 162, 163 and 
164, respectively. The overall mean was 2.02. 

Figure 2 shows log initial-link response 
ratios as a function of log reinforcer probabil- 
ity ratio in the signaled conditions for the 
same 4 subjects. Individual sensitivity values 
averaged across components were 1.30, 1.23, 
1.70 and 1.48 for Pigeons 161, 162, 163 and 
164, respectively, with an overall mean of 1.43. 
Overall, sensitivity was 29% lower in these 
conditions, exemplifying the signaling effect. 
Specifically, sensitivity values were lower in 
signaled relative to unsignaled conditions in 
every component for every subject, and this 
difference was significant on a Wilcoxon 
matched-pairs signed-ranks test, z = 3.51, p < 
.05. 

In addition to the main signaling effect, 
there also appeared to be a reduction in 
sensitivity to relative reinforcer immediacy in 
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Unsignalled -- Dependent scheduling group 
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Log Reinforcer Probability Ratio 

Fig. 1. Logio initial-link response ratios (left/ right) are plotted against logio reinforcer probability ratios in the 
unsignaled conditions, for subjects in the independent scheduling group. Equations of least-squares regression lines are 
shown for each subject for the red, white, and green components, separately and in that order. Filled circles represent 
data from red components, unfilled squares represent data from white components, and filled triangles represent data 
from green components. 


the signaled conditions. Sensitivity to relative 
immediacy appears as the vertical distance 
between the regression lines for individual 
components in Figures 1 and 2, measured by 
the intercept values of the fitted regression 
lines. In both figures, regression lines for 
the red component have positive intercept 
values, those for the white component have 
intercept values close to 0 (on average, —0.03), 
and those in the green component have 
negative intercept values. The range over 
which intercept values varied indicates the 
degree to which relative immediacy controlled 
response allocation, and appears generally to 
be smaller in signaled than in unsignaled 
conditions. 


Figures 3 and 4 repeat the above analyses for 
the subjects in the independent scheduling 
group, and confirm both of the main results 
reported above. Figure 3 shows log initial-link 
response ratios as a function of log probability 
ratios in the unsignaled conditions for the 4 
subjects. Again, all subjects displayed high 
levels of sensitivity to relative probability in 
each component when the terminal links were 
unsignaled. Sensitivity values varied across 
components for individual subjects, but the 
variation appears unsystematic. Individual sen- 
sitivity values, averaged across components, 
were 1.67, 2.28, 1.79 and 1.77 for Pigeons 185, 
186, 187 and 188, respectively, with an overall 
mean of 1.88. 
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Fig. 2. Logio initial link response ratios (left/right) are plotted against logio reinforcer probability ratios in the 
signaled conditions, for subjects in the independent-scheduling group. Equations of least-squares regression lines are 
shown for each subject for the red, white, and green components, separately and in that order. Filled circles represent 
data from red components, unfilled squares represent data from white components, and filled triangles represent data 
from green components. 


Figure 4 shows the log initial-link response 
ratio as a function of the log probability ratio 
in the signaled conditions for the same 4 
subjects. Response allocation for all subjects 
was sensitive to relative reinforcer probability 
in each component when the terminal links 
were signaled, and sensitivity values were 
comparable across components. Individual 
subjects’ sensitivity values, averaged across 
components, were 0.69, 1.26, 1.76 and 1.53 
for Pigeons 185, 186, 187 and 188, respectively, 
with an overall mean of 1.31. As with the 
dependent-scheduling group, the sensitivity 
values were substantially lower in the signaled 
conditions relative to the unsignaled condi- 
tions. This difference was found in 9 out of 12 


individual comparisons (Wilcoxon matched- 
pairs signed-ranks test; z = 2.35, p < .05). As 
for the dependent-scheduling group, the 
intercepts of regression lines, which reflect 
control of response allocation by relative 
immediacy of reinforcement, varied across 
components. Comparing the range over which 
they varied for unsignaled conditions (Fig- 
ure 3) and signaled conditions (Figure 4), it 
appears that the degree of control was higher 
in the unsignaled conditions. 

A possible complication in the case of the 
independent scheduling group was that sensi- 
tivity values may partly reflect sensitivity 
to relative terminal-link entry ratios, which 
are free to vary with changes in subjects’ 
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Unsignalled - Independent scheduling group 
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Log Reinforcer Probability Ratio 

Fig. 3. Logio initial link response ratios (left/right) are plotted against logio reinforcer probability ratios in the 
unsignaled conditions, for subjects in the dependent-scheduling group. Equations of least-squares regression lines are 
shown for each subject for the red, white, and green components, separately and in that order. Filled circles represent 
data from red components, unfilled squares represent data from white components, and filled triangles represent data 
from green components. 


preference in this procedure. To assess wheth- 
er the difference in sensitivity between sig- 
naled and unsignaled conditions remained 
when sensitivity of initial-link response ratios 
to relative terminal-link entry rates was ac- 
counted for, we re-estimated abusing Equation 
2. Specifically, we entered the obtained entry 
rates as Rj and R 2 , and fixed an at 1.0. Because 
relative immediacy of reinforcement was con- 
stant within components, we fixed (at 0) 
and let the constant log c account for the 
effects of relative reinforcer immediacy in 
different components. Values for ap and log c 
are given in Table 2, separately for the three 
components and for signaled and unsignaled 


conditions. Values for ap were greater in 
unsignaled conditions in 11 out of 12 cases, 
an even stronger result than is seen in 
Figures 3 and 4. The single exception. Bird 
187 in the red component, gave sensitivity 
values of 1.08 in the signaled condition and 
1.00 in the unsignaled condition. In all other 
cases, the sensitivity values differed by 0.10 or 
more and overall, sensitivity was lower in 
signaled conditions by 27%. 

Sensitivity to Relative Immediacy of Reinforcement 

Inspection of intercept values in Figures 1 
through 4 suggested that the effect of signal- 
ing reinforcement and nonreinforcement on 
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Fig. 4. Logio initial link response ratios (left/right) plotted against logio reinforcer probability ratios in the signaled 
conditions, for subjects in the dependent-scheduling group. Equations of least-squares regression lines are shown for 
each subject for the red, white, and green components, separately and in that order. Filled circles represent data from red 
components, unfilled squares represent data from white components, and filled triangles represent data from 
green components. 


individual trials was not limited to sensitivity to 
relative reinforcer probability, and that sensi- 
tivity to relative immediacy was also reduced. 
We conducted further analysis of sensitivity to 
immediacy, regressing log initial-link response 
ratios on log immediacy ratios, separately for 
each of the four log probability ratios and for 
signaled and unsignaled conditions. Individual 
results for the 4 subjects in the independent- 
scheduling group were obtained by fitting 
Equation 2, using obtained rates of terminal- 
link entry for Ri and i? 2 - As before, the 
parameter was fixed at 1.0 and the ap 
parameter was fixed at 0, letting the constant 
log c account for the effects of reinforcer 


probability across conditions. The results are 
given in Table 3. 

With few exceptions, the fits were satisfacto- 
ry. Equation 2 accounted for 85% or more of 
the (log ratio) variance in preference in 57 out 
of 64 cases. The mean values for ap, for the 
dependent-scheduling group were 2.35 in the 
unsignaled conditions, and 1.52 (35% lower) 
in the signaled conditions (Wilcoxon test, z = 
2.33, p < .05). For the 4 subjects in the 
independent-scheduling group, the mean val- 
ues for ap, were 1.64 in the unsignaled 
conditions and 1.15 (30% lower) in the 
signaled conditions, and again the difference 
was statistically significant (Wilcoxon test, z = 
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Table 2 

Parameter values from fits of Equation 2 to initial-link log response ratios in the 
three components. 


Pigeon 


Red Component 

White Component 

Green Component 

dp 

log c 

VAC 

dp 

log c 

VAC 

dp 

log c 

VAC 

185 

Unsignaled 

1.20 

0.46 

.98 

1.10 

0.09 

.97 

0.80 

-0.37 

.96 


Signaled 

0.84 

0.30 

.98 

0.54 

0.15 

.92 

0.46 

-0.05 

.95 

186 

Unsignaled 

1.14 

0.79 

.96 

1.62 

-0.16 

.97 

0.85 

-0.40 

.97 


Signaled 

1.03 

0.62 

.99 

0.86 

0.05 

.98 

0.67 

-0.43 

.92 

187 

Unsignaled 

1.00 

0.62 

.99 

1.27 

0.12 

.98 

1.51 

-0.20 

.93 


Signaled 

1.08 

0.45 

.97 

1.03 

0.30 

.99 

0.98 

-0.14 

.98 

188 

Unsignaled 

1.04 

0.67 

.99 

1.25 

0.11 

.91 

1.47 

-0.46 

.93 


Signaled 

0.82 

0.82 

.96 

1.00 

0.32 

.99 

1.16 

0.04 

.98 


Note. Analyses used obtained terminal-link entry rates with fixed at 1.0, ratios of arranged reinforcer probabilities, 
and ajj fixed at zero. The proportion of variance accounted for by the fit (VAC) is also given. (Data from the 
independent-scheduling group.) 


2.77, p < .05). Across the 8 subjects in two 
groups, greater sensitivity to immediacy in 
unsignaled than in signaled conditions was 
found in 24 out of 32 comparisons, confirming 
an effect of signaling on sensitivity of initial- 
link response ratios to relative immediacy of 
reinforcement. 

In the analyses presented above we account- 
ed for variations in relative terminal-link entry 
rate for the independent-scheduling group by 
fitting Equation 2 using obtained terminal-link 


entry rates for Ri and Ri, with an fixed at 1 .0. It 
is possible that different conclusions might be 
reached if was higher or lower than this. 
Accordingly, we reassessed the effect of un- 
equal terminal link entry in further analyses 
which varied an upwards from 0.5 in steps of 
0.15, and asked whether the signaling effect 
remained as an increased. The results of these 
analyses were that sensitivity to relative imme- 
diacy remained significantly greater {p < .05 
on a Wilcoxon test) in unsignaled conditions 


Table 3 

Fitted values for aj) and log c (Equation 2) for each pigeon and each log reinforcer probability 
ratio in the unsignaled and signaled conditions. 


Log reinforcer probability ratio 


-0.69 

-0.3 

0.3 

0.69 


Pigeon 


dj) 

log c 

VAC 

dl) 

log c 

VAC 

an 

log c 

VAC 

dj) 

log c 

VAC 

Dependent-scheduling grouf. 
161 Unsignaled 

} 

1.78 

-1.36 

1.00 

2.02 

-0.50 

.75 

3.04 

0.61 

.80 

2.59 

1.05 

1.00 


Signaled 

0.35 

-1.10 

.98 

0.78 

-0.22 

.99 

0.50 

0.46 

.83 

1.09 

0.76 

.99 

162 

Unsignaled 

1.48 

-1.52 

.96 

4.38 

-0.42 

1.00 

2.65 

0.72 

.99 

1.65 

1.63 

.82 


Signaled 

2.73 

-0.56 

.99 

2.44 

-0.33 

.99 

1.54 

0.83 

1.00 

2.13 

0.99 

1.00 

163 

Unsignaled 

0.87 

-1.68 

.87 

3.93 

-0.29 

.95 

3.34 

1.14 

.94 

1.47 

1.77 

.95 


Signaled 

0.80 

-1.15 

.92 

0.98 

-0.85 

.99 

1.93 

0.53 

.91 

0.36 

1.08 

.77 

164 

Unsignaled 

1.97 

-1.22 

1.00 

2.57 

-0.83 

.95 

2.62 

0.33 

.97 

1.21 

1.09 

1.00 


Signaled 

1.24 

-1.18 

1.00 

3.29 

-0.55 

.89 

2.96 

0.35 

.99 

1.22 

0.89 

.96 

Independent-scheduling group 
185 Unsignaled 0.95 

-0.55 

1.00 

0.90 

-0.36 

.98 

2.16 

0.29 

.99 

1.48 

0.87 

.98 


Signaled 

0.39 

-0.27 

.74 

0.07 

-0.11 

.86 

0.78 

0.39 

.99 

1.11 

0.52 

1.00 

186 

Unsignaled 

0.86 

-0.57 

.90 

3.06 

-0.55 

.96 

1.72 

0.44 

.94 

2.26 

0.98 

1.00 


Signaled 

0.95 

-0.53 

.97 

1.96 

-0.11 

.97 

2.19 

0.26 

1.00 

1.84 

0.70 

1.00 

187 

Unsignaled 

1.84 

-0.80 

1.00 

1.54 

-0.02 

.99 

1.63 

0.51 

1.00 

0.41 

1.03 

.96 


Signaled 

0.33 

-0.33 

.65 

1.31 

-0.30 

.98 

1.96 

0.39 

.98 

0.31 

1.06 

.97 

188 

Unsignaled 

2.05 

-0.70 

.99 

2.27 

-0.35 

.98 

2.33 

0.50 

.99 

0.82 

0.99 

.99 


Signaled 

1.69 

-0.18 

1.00 

1.16 

0.01 

.89 

1.86 

0.53 

.98 

0.48 

1.22 

1.00 


Note. The proportion of variance accounted for (VAC) is given for each fit. Analyses for subjects in the independent- 
scheduling group used obtained log terminal-link entry ratios, with fixed at 1.0. 
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Table 4 

Parameter estimates and proportion of variance accounted for by the concatentated generalized- 
matching model (Equation 2) when fitted to the data from individual pigeons. 



Pigeon 

log c 

a,, (unsig) 

a.p (sig) 

a,) (unsig) 

a-u (sig) 

VAC 

Independent 

185 

0.10 

1.0.S 

0.62 

1.37 

0.59 

0.97 


186 

0.08 

1.20 

0.85 

1.97 

1.73 

0.96 


187 

0.19 

1.25 

1.03 

1.35 

0.98 

0.96 


188 

0.25 

1.25 

0.99 

1.87 

1.30 

0.96 


Average 

0.15 

1.18 

0.87 

1.64 

1.15 

0.96 

Dependent 

161 

-0.04 

1.76 

1.31 

2.38 

0.68 

0.94 


162 

0.17 

2.22 

1.25 

2.52 

2.20 

0.94 


16.S 

0.07 

2.48 

1.73 

2.41 

1.00 

0.92 


164 

-0.14 

1.72 

1.49 

2.09 

2.18 

0.94 


Average 

0.01 

2.05 

1.44 

2.35 

1.52 

0.94 


Note. Results are shown separately for the groups with independent and dependent initial-link schedules. 


up to a value of an = 1.4. At this value and 
above, fitted values for ao sometimes became 
substantially negative, which seems implausi- 
ble. Overall, this analysis shows that the effect 
of signaling on sensitivity to relative reinforcer 
immediacy was robust to substantial variation 
in an- 

To provide an economical description of the 
data in terms of the generalized matching law, 
a version of Equation 2 with separate sensitivity 
parameters {ao and «p) for signaled and 
unsignaled conditions was fitted to the indi- 
vidual data. For the independent-schedules 
group, the value of a/; was set equal to 1. For 
each pigeon, there were five parameters 
estimated from 24 data points. Table 4 
gives the results for individual pigeons, and 
Figure 5 shows the average bias and sensitivity 


2.50 -I 



logb aP(unsig) aP(sig) aD(unsig) aD(sig) 


Fig. 5. Average sensitivities to delay {aj^ and proba- 
bility (ap) for signalled and unsignaled conditions, and 
bias (log h), estimated from fits of the generalized- 
matching model (Equation 2) to data from individual 
pigeons. Results for the independent and dependent 
scheduling group are shown by dark and light gray 
columns, respectively. Error bars indicate +/— 1 SE. 


parameters separately for group and signaling 
condition. The generalized-matching model 
provided a good description of the data, 
accounting for an average of 96% and 94% 
of the variance for the independent and 
dependent groups, respectively. Sensitivity to 
probability («p) was higher in the unsignaled 
condition for both groups (means = 1.19 and 
0.87, and 2.05 and 1.45, respectively for 
independent and dependent scheduling), as 
was sensitivity to immediacy (means = 1.64 
and 1.15, and 2.35 and 1.52). An ANOVA on 
the sensitivity parameters, with variable (prob- 
ability vs. immediacy) , signaling condition and 
group as factors, found a significant effect of 
signaling condition, T(l,6) = 20.28, p < .05, 
confirming that sensitivity to both probability 
and immediacy was greater in the unsignaled 
condition. The effect of group was also 
significant, 7^(1, 6) = 14.88, p < .05, indicating 
that sensitivity was greater for the dependent 
group. Neither the main effect of variable nor 
any of the interactions was significant. 

Independence of Probability and Immediacy'? 

Figure 6 shows the average results for both 
groups in the signaled and unsignaled condi- 
tions. To confirm the findings reported above 
and to provide a formal test of a possible 
interaction between immediacy and probabil- 
ity, we conducted a 2 (Group) X 4 (Log 
Probability Ratio) X 3 (Log Immediacy ratio) 
X 2 (signaled/unsignaled) repeated-measures 
ANOVA. The main effects of probability and 
immediacy ratios were both significant, F 
(3,18) = 240.30, and T(2,12) = 58.25, respec- 
tively, p < .05. The signaling effects reported 
above were supported by interactions of 
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Fig. 6. Average log response ratios plotted as a function of log probability ratios (upper panels) and log immediacy 
ratios (lower panels). Results for shown separately for dependent and independent scheduling groups, and for 
unsignaled and signaled conditions. Error bars indicate +/— \ SE. 


signaling condition with log probability ratio, 
/'(3,18) = 6.28, p < .05, and with log 
immediacy ratio, F{2,\2) = 10.40, p < .05. 
There was also a significant interaction be- 
tween group and log probability ratio, consis- 
tent with the greater sensitivity to probability 
ratios in the dependent-scheduling group than 
in the independent-scheduling group, seen in 
Figures 1-4, T(3,18) = 3.17, p < .05. The 
interaction between probability and immedia- 
cy was not significant, T(6,36) = 1.78, p = .13. 
None of the other main effects or interactions 
was significant. 

Although the lack of a significant interac- 
tion suggests that the effects of probability 
and immediacy ratios on choice are indepen- 
dent, visual inspection of Figure 6 suggests 
that the effect of immediacy ratios was greater 
at moderate than extreme probability ratios. 


particularly for the dependent-schedules 
group. We ran separate ANOVAs for the two 
groups and found that the probability X 
immediacy interaction was significant for the 
dependent-schedules group F’(6,18) = 3.53, p 
< .05, but not for the independent-schedules 
group, F’(6,18) = 0.23, p = .96. Analysis of 
simple effects for the dependent-schedules 
group found that the probability X immediacy 
interaction was significant for the unsignaled 
condition {p < .05), but not the signaled 
condition {p = .46). 

An interaction effect of the type described 
above might result if there was a ceiling effect 
on response allocation. For example, the 
requirement that the terminal links are en- 
tered equally often (dependent scheduling) 
places a lower bound on response rate to the 
less-preferred key in the initial link, and 
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potentially, a constraint on response ratios. 
Consistent with this interpretation, the inter- 
action was only significant for the dependent- 
schedules group (when log response ratios 
were analyzed). To explore this possibility. 
Figure 7 shows obtained log response alloca- 
tion as a function of predictions by the 
generalized-matching model (Equation 2). 
To generate this figure, results for individuals 
were pooled. The solid line in each panel is 
the line of equality {y = x) so that systematic 
deviations in predictions can be observed. 
Figure 7 shows that results for the dependent 
group unsignaled condition (lower right pan- 
el) reveal the interaction between probability 
and immediacy as a clear sigmoidal pattern 
that is consistent with a ceiling on maximum 
response allocation at approximately 2 log 
units (i.e., 100:1). Results for the dependent 
group signaled condition (upper right panel) 
show a similar trend, but not as pronounced. 
By contrast, results for the independent group 
(left panels) indicate no systematic deviation 
from prediction. 

Overall, these results suggest that the 
reduction in sensitivity to immediacy at ex- 
treme probability ratios for the dependent 
schedules group — and hence the interaction 
between probability and immediacy — may 
have been caused by a ceiling effect on 
response allocation. The unsignaled condition 
showed the clearest evidence of this effect, 
which is reasonable because it generated the 
more extreme preference. However, there is 
some ambiguity because the three-way interac- 
tion (probability X immediacy X signaling) 
was not significant, suggesting that the differ- 
ences between the separate two-way interac- 
tions for the signaled and unsignaled condi- 
tions were not significant. 

Stability 

Finally, because no formal stability criterion 
was used during the experiment we assessed 
performance over sessions in each condition 
to check that it met a commonly used criterion 
for stability. The criterion was that the median 
response proportion over five sessions was 
within .05 of the median of the previous five 
sessions, met five times (not necessarily con- 
secutively) during training. Of 192 perfor- 
mances (8 birds X 3 delay ratios X 4 
probability ratios X 2 signaling conditions), 
only 6 failed to meet this criterion during 


training. In each of these cases, we then 
calculated average response proportions in 
five-session blocks and inspected these visually 
for trends over the last four blocks. Trends 
over blocks were suspected in four cases, all 
were in unsignaled conditions and all suggest- 
ed increasing responding to the left key. Three 
of these cases were Birds 186 in Component 1 
(FT 10 FT 20) of Conditions 5 and 8, and Bird 
162 in Component 1 of Condition 6. The 
fourth case was Bird 185 in Component 3 (FT 
15 FT 15). These trends imply that sensitivity 
to delay may be slightly greater in unsignaled 
conditions than is reported above, since 
preference for the shorter delay may have 
been still increasing. Since our major result is 
that sensitivity is greater when reinforcement 
outcomes are unsignaled, these trends do not 
undermine our conclusions. For probability, 
trends imply that sensitivity may be a little 
lower than is reported above for Birds 185 and 
162 in unsignaled conditions. However, be- 
cause the affected conditions involved moder- 
ate probability ratios (1:2 or 2:1), lower 
preference in these conditions would have 
little effect on sensitivity estimates overall. 
Thus, we conclude that our subjects’ perfor- 
mances were sufficiently stable to support our 
major conclusions. 

DISCUSSION 

The primary goals of the present study were 
to characterize the effects on choice of 
variation in reinforcer immediacy and proba- 
bility in terms of the generalized matching law, 
to determine if their effects were additive and 
independent, and to compare results depend- 
ing on whether terminal-link outcomes (i.e., 
reinforcement or blackout) were signaled. We 
trained 8 pigeons in a three-component 
concurrent-chains procedure in which the 
terminal links were FT schedules which varied 
across components (2:1, 1:1, and 1:2 immedi- 
acy ratios) while the reinforcer probabilities 
were varied across conditions. There were two 
groups (w = 4) which differed in terms of 
whether independent or dependent VI sched- 
ules were used for the initial links. Results 
showed that the generalized matching law 
(Equation 2) provided an excellent descrip- 
tion of the data, accounting for an average of 
92% of the variance in response allocation 
overall. Sensitivity to reinforcer probability and 
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Fig. 7. Scatterplots of obtained versus predicted log response ratios based on fits of the generalized matching model 
(Equation 2) to data from individual pigeons. Results are shown separately for the independent-scheduling group (left 
panels), dependent-scheduling group (right panels), signaled condition (upper panels), and unsignaled condition 
(lower panels). 


immediacy were both greater in the un- 
signaled conditions, suggesting that the effect 
of signaling terminal-link outcomes may not 
be specific to probability but may affect 
terminal-link reinforcer variables in general. 

Another goal was to investigate the assump- 
tion of the generalized matching law that 
different reinforcer variables have additive and 
independent effects on choice. We tested 
whether effects of probability and immediacy 
on choice were independent with an ANOVA 
(cf. Elliffe et al., 2008). Consistent with the in- 
dependence assumption, the interaction was not 
significant in the overall ANOVA. However, 
visual inspection (see Figure 6) suggested 


that sensitivity to immediacy was greater at 
moderate rather than extreme probability 
ratios for the dependent-schedules group. 
This observation was supported by an analysis 
of simple effects which showed that the 
probability X immediacy interaction was 
significant for the dependent-schedules group 
but not the independent-schedules group. 
Scatterplots of predictions of the generalized- 
matching model versus obtained data (Fig- 
ure 7) showed evidence of a possible ceiling 
effect in response allocation for the depen- 
dent-scheduling group in the unsignaled 
condition at approximately 2 log units. This 
effect would be expected to have a greater 
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impact at extreme rather than moderate 
probability ratios, and thus could have pro- 
duced the interaction for the dependent- 
schedules group. In that case, the interaction 
might not represent failure of a key match- 
ing-law assumption, but be attributed to a 
procedural artefact. Sigmoidal relationships 
between log response and log reinforcer 
ratios that might be attributed to ceiling 
effects produced by dependent scheduling 
have been reported before (e.g., Davison & 
Jones, 1995; but cf. Baum, Schwendiman & 
Bell, 1999), particularly in situations where 
several values of a given reinforcer dimension 
are presented within sessions (as in the 
present experiment) or when conditions are 
in effect for only one or two sessions at a time 
(Grace, Bragason & McLean, 2003; Grace & 
McLean, 2006) . However, it must be acknowl- 
edged that our results were ambiguous in that 
the three-way interaction (probability X im- 
mediacy X signalling) , which would have 
allowed us to conclude that the probability 
X immediacy interaction was limited to the 
unsignaled condition for the dependent- 
schedules group, was not significant. 

Although comparing results between the 
groups with independent and dependent ini- 
tial-link scheduling was not a primary goal, it is 
interesting to note that sensitivity to probability 
and immediacy were significantly greater in the 
dependent-scheduling group (see Figure 5 and 
Table 4) . This was associated with our inclusion 
of a term for relative terminal-link entry rate in 
Equation 2, which can vary with response 
allocation under independent but not depen- 
dent schedules. In the analyses of sensitivity by 
component in Figures 1 through 4, entry rate 
was not taken into account and, while sensitiv- 
ities were higher for the dependent group, the 
differences were not as large and did not reach 
statistical significance. For example, the average 
sensitivity to probability in the unsignaled 
conditions was 2.02 for the dependent group 
versus 1.88 for the independent group. It 
remains an open question whether indepen- 
dent and dependent scheduling arrange- 
ments yield equivalent estimates of sensitivity 
to reinforcer variables. 

Previous research on choice between uncer- 
tain outcomes has shown that strong pre- 
ference is established for the higher reinforc- 
er-probability alternative in standard unsignaled 
procedures (e.g., Spetch & Dunn, 1987), but 


when outcomes (reinforcement or nonrein- 
forcement) scheduled for each trial are signaled 
during terminal links, this preference is weaker. 
Fantino, Dunn and Meek (1979), for example, 
varied probability ratios over the range 1:4 to 4:1 
using signaled conditions, and reported data 
consistent with sensitivity values in the range 0.5 
to 0.8. Sometimes, preference has been found 
to reverse so that response allocation favors the 
poorer alternative (e.g., Kendall, 1974, 1985). 
This reversal has been found to be more 
common in procedures with short initial links 
and long terminal links (Dunn & Spetch, 1990; 
Kendall, 1985). Our results are consistent with 
this previous research, both in that strong 
preferences were found in unsignaled condi- 
tions for the alternative with the higher proba- 
bility of reinforcement, and in that preference 
reduced significantly when outcomes were 
signaled. However, we did not find actual 
reversals of preference, which would be indicat- 
ed by negative values of sensitivity to probability 
in the signaled conditions. 

Of the existing studies of signaling in 
probabilistic reinforcement procedures, no 
previous study has jointly varied probability with 
another reinforcement variable. Our second 
main finding, that signaling probabilistic rein- 
forcers also affected sensitivity to delay, was 
therefore novel. This result is surprising, be- 
cause the steady houselight used to signal 
reinforcer availability at the end of a terminal 
link did not provide any information relevant to 
reinforcer delay (at least, nothing that was not 
already signaled by the side-key that was 
illuminated during the terminal link). Yet, 
sensitivity to immediacy was reduced from an 
average (across 8 birds) of 2.00 to 1.34. This 
reduction, 33%, was similar to the 28% reduc- 
tion seen in sensitivity to probability. The 
finding that sensitivity to both reinforcer vari- 
ables was similarly affected by signaling suggests 
that signaling outcomes may have a global effect 
on sensitivity to events in the terminal links. 

Models of choice that view terminal-link 
stimuli as conditioned reinforcers (stimuli that 
acquire reinforcing strength by association 
with primary reinforcement) have been suc- 
cessful when applied to signaled procedures in 
past research. An explanation of the signaling 
effect in these terms holds that where the 
probability of reinforcement in the terminal 
link is low, stimuli that signal reinforcing 
outcomes (i.e., as opposed to extinction) 
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acquire strong conditioned reinforcement 
value (see Dunn & Spetch, 1990) . Thus, the 
choice made in the initial link is between a low 
prohahility of primary reinforcement plus 
strong conditioned reinforcement, on the 
one hand, versus a higher probability of 
primary reinforcement plus low (or zero) 
conditioned reinforcement. The added condi- 
tioned reinforcement, which develops only in 
the signaled procedure, therefore reduces 
preference for the alternative with the higher 
probability of primary reinforcement. 

Conditioned reinforcement may also explain 
the effect of signaling on sensitivity to relative 
immediacy, although not in the way described 
above. Two ways in which conditioned rein- 
forcement may be included in the concatenated 
matching law (Equation 2) are outlined below, 
and explored with respect to the signaling 
effects reported here. First, additional condi- 
tioned reinforcement due to signaling (CR) 
could function similarly to other reinforcer 
variables and make an independent and addi- 
tive contribution to response allocation. In this 
case, a separate term for relative CR could be 
included in Equation 2 as follows: 

log^ = log c-f Ur log + ao log 

+ (^) + (§) 

+ a,cR log 

It is not known how CRi and CR^ may be 
computed, but if conditioned reinforcement for 
an alternative is inversely related to the proba- 
bility of primary reinforcement (Pi or Pg) , as was 
suggested by Spetch and Dunn (1987), then the 
last two log ratios must be inversely related to 
one another and their summation predicts the 
reduction in sensitivity to relative probability 
(flp) that occurs when trial outcomes are 
signaled. The secondary effect of signaling is 
not so easily accommodated, however. To 
predict a reduction in sensitivity to relative 
immediacy of reinforcement, CR must similarly 
be inversely related to reinforcer immediacy 
(i.e., positively related to delay), which seems 
implausible. 

A second approach assumes that condi- 
tioned reinforcement is added to the value of 
each alternative, where value is determined by 




the product of the terminal-link variables (i.e., 
immediacy, magnitude, and probability). If 
rates of entry to the two terminal links are 
equal, the resulting model is: 



logc-l-aijlog 


Pi 

Ri 


+ log 


Fi -f CPi' 
Ta + CRi 


( 4 ) 


where T=(l/D)"^-M“"-P“^ 

Again, if conditioned reinforcement is an 
inverse function of reinforcer probability, the 
addition of CR\ and CR^ to terminal-link value 
moves response ratios towards indifference, so 
Equation 4 models the signaling effect. Be- 
cause neither log immediacy ratios nor log 
probability ratios are affected, the slopes of 
lines relating log (P 1 /P 2 ) to both of these 
reinforcement variables must be reduced. 
That is, the assumptions embodied in Equa- 
tion 4 can predict the reduction in sensitivity 
to both immediacy and probability of rein- 
forcement when outcomes are signaled. In 
fact, sensitivities to both immediacy and 
probability are reduced even if CPi = CP 2 , so 
Equation 4 is consistent with the ordinal 
effects in the present data across a wide range 
of assumed relative values for CR\ and CR^- 
Equation 4 can be extended to a version of 
Grace’s (1994) Contextual Choice Model if the 
rightmost term (i.e., log value ratio) is multi- 
plied by Ti/ Ti. This results in a prediction that 
T/Pj should modulate sensitivity to reinforcer 
immediacy and probability similarly in un- 
signaled and signaled conditions. The effects 
of varying initial- and terminal-link durations in 
unsignaled conditions are reasonably consistent 
with the above prediction (Spetch & Dunn, 
1987; Experiment 2) but in signaled conditions, 
their effects appear to be inconsistent with it 
(Kendall, 1974; 1985; Dunn & Spetch, 1990). 
Kendall (1974; 1985) reported data suggesting 
decreases in preference for the higher-proba- 
bility alternative as terminal-link delay in- 
creased, and increases as the durations of initial 
links increased. These changes are the reverse 
of the usual effects observed in unsignaled 
conditions (Spetch & Dunn) . Dunn and Spetch 
found no clear effect of varying initial- or 
terminal-link durations in signaled conditions 
in their Experiment 1. In their Experiment 2, 
they found increasing preference with in- 
creasing terminal-link duration in unsignaled 
conditions, and again, no effect of terminal-link 
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duration in signaled conditions. In their Exper- 
iment 3, they found an increase in preference as 
initial-link durations increased from 0 to 10 s in 
signaled conditions, but no effect of further 
variation up to 40 s. Thus, only data from their 
Experiment 3 suggest an effect in signaled 
conditions, and overall, existing data suggest 
that in signaled conditions preference is not 
reliably affected by temporal context. 

A second expectation that derives from 
Equation 4 is that the secondary effect of 
signaling will only be found with sensitivity to 
terminal-link variables. More specifically, sen- 
sitivity to relative rate of terminal-link entry 
should be unaffected by signaling trial out- 
comes when reinforcement in terminal links is 
uncertain. This prediction, in contrast with the 
secondary effects of signaling on sensitivity to 
relative delay in the present study, comes 
about because Equation 4 assumes that condi- 
tioned reinforcement is added to terminal-link 
value. One way to assess the validity of 
Equation 4 may, therefore, be to study the 
effects of initial- and terminal-link determiners 
of preference under signaled and unsignaled 
conditions. 

To conclude, we used a flashing houselight to 
signal outcomes in terminal links with probabi- 
listic reinforcement, and found that signaling 
probabilistic reinforcers reduced sensitivity of 
choice to relative probability of reinforcement, 
in accord with previous data. We also report a 
new effect, namely, that the same signaling 
reduced sensitivity of choice to relative immedi- 
acy of reinforcement, which we varied paramet- 
rically with relative probability. We showed that 
both of these effects of signaling can be modeled 
by incorporating conditioned reinforcement 
into the matching law, such that the value of 
each terminal link is determined, conditioned 
reinforcement is added, and the ratio of sums 
determines initial-link preference. A full evalua- 
tion of this approach must await data on the 
effects of signaling on sensitivity to relative rate 
of terminal-link entry, and on sensitivity to other 
terminal-link reinforcer variables. 
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APPENDIX 

Raw data for individual subjects, aggregated over the last ten sessions of each condition. ^(Left), 
/?(Right) = terminal-link reinforcer probabilities; = initial-link responses; = terminal- 

link entries; rj ,rji = terminal-link reinforcers; rtjj rtji = terminal-link response rates (lOx resp/min; 
subscripts L and R indicate the left and right alternatives). 
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571.30 

8 

Red 

0.83 

0.17 

u 

8242 

284 

92 

94 

75 

14 

306.20 

388.84 


(FT 10 FT 20) 
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Dependent Scheduling Group 


Condition Component 

^(Left) 

/"(Right) 

Unsig 

B,. 

Br 

pl 

Sr 

rL 

rR 

rtL 

rtR 

1 

WTiite 




0.17 

0.83 

s 

450 

6432 

117 

118 

19 

98 

107.39 

243.56 


(FT 

15 

FT 

15) 












2 

White 




0.33 

0.67 

s 

687 

6086 

117 

116 

38 

77 

133.17 

212.52 


(FT 

15 

FT 

15) 












3 

White 




0.67 

0.33 

s 

4425 

2530 

120 

117 

80 

38 

344.67 

198.59 


(FT 

15 

FT 

15) 












4 

White 




0.83 

0.17 

s 

5510 

864 

120 

120 

100 

20 

101.00 

247.67 


(FT 

15 

FT 

15) 












5 

White 




0.17 

0.83 

u 

456 

7229 

113 

114 

19 

96 

634.80 

631.33 


(FT 

15 

FT 

15) 












6 

White 




0.33 

0.67 

u 

568 

6294 

117 

116 

38 

77 

75.39 

732.83 


(FT 

15 

FT 

15) 












7 

White 




0.67 

0.33 

u 

4792 

1507 

117 

119 

76 

40 

178.83 

470.79 


(FT 

15 

FT 

15) 












8 

White 




0.83 

0.17 

u 

7573 

637 

114 

115 

94 

19 

346.77 

799.51 


(FT 

15 

FT 

15) 












1 

Green 




0.17 

0.83 

s 

249 

9122 

115 

116 

19 

96 

61.93 

369.62 


(FT 

20 

FT 

10) 












2 

Green 




0.33 

0.67 

s 

397 

8883 

115 

114 

36 

77 

59.73 

411.00 


(FT 

20 

FT 

10) 












3 

Green 




0.67 

0.33 

s 

1699 

5265 

118 

115 

78 

38 

117.95 

418.79 


(FT 

20 

FT 

10) 












4 

Green 




0.83 

0.17 

s 

4208 

1159 

105 

101 

87 

15 

93.52 

511.14 


(FT 

20 

FT 

10) 












5 

Green 




0.17 

0.83 

u 

159 10634 

103 

103 

16 

85 

322.75 

678.25 


(FT 

20 

FT 

10) 












6 

Green 




0.33 

0.67 

u 

296 

9458 

117 

116 

38 

76 

40.00 

632.82 


(FT 

20 

FT 

10) 












7 

Green 




0.67 

0.33 

u 

1538 

5402 

118 

119 

79 

40 

92.95 

838.00 


(FT 

20 

FT 

10) 












8 

Green 




0.83 

0.17 

u 

6204 

1140 

116 

115 

96 

18 

453.21 

941.93 


(FT 

20 

FT 

10) 













Independent Scheduling Group 

Sig/ 

Condition Component p(Left) /;(Right) Unsig Br e/, €r yr Hr Hr 


1 

Red 

(FT 10 FT 20) 

0.17 

0.83 

S 

1681 2807 

118 

122 

18 

102 

146.27 

78.07 

2 

Red 

(FT 10 FT 20) 

0.33 

0.67 

S 

1995 2296 

122 

118 

40 

77 

1.33.88 

123..32 

3 

Red 

(FT 10 FT 20) 

0.67 

0.33 

S 

5099 1100 

128 

112 

87 

36 

526.70 

59.98 

4 

Red 

(FT 10 FT 20) 

0.83 

0.17 

S 

7053 553 

151 

89 

127 

11 

831.65 

59.31 

5 

Red 

(FT 10 FT 20) 

0.17 

0.83 

U 

1572 2927 

112 

118 

20 

102 

196.10 

97.96 

6 

Red 

(FT 10 FT 20) 

0.33 

0.67 

u 

2284 3011 

122 

118 

42 

78 

196.16 

123.55 

7 

Red 

(FT 10 FT 20) 

0.67 

0.33 

u 

10373 437 

169 

71 

115 

24 

464.89 

46.30 

8 

Red 

(FT 10 FT 20) 

0.83 

0.17 

u 

12.348 28 

212 

8 

175 

0 

400.99 

28.50 

1 

White 

(FT 15 FT 15) 

0.17 

0.83 

s 

1813 2591 

121 

119 

22 

97 

62.52 

126.92 

2 

White 

(FT 15 FT 15) 

0.33 

0.67 

s 

1614 2407 

115 

125 

40 

86 

76.79 

125.78 

3 

White 

0.67 

0.33 

s 

4183 1380 

128 

112 

85 

37 

1.36.20 

87.81 


(FT 15 FT 15) 
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Independent Scheduling Group 
Condition Component 

^(Left) 

^(Right) 

Sig/ 

Unsig 

Bl Br 

ec 

PR 


rR 

rtL 

rtR 

4 

White 

0.83 

0.17 

s 

4036 1295 

121 

119 

95 

21 

131.25 

75.65 


(FT 15 FT 15) 











5 

White 

0.17 

0.83 

u 

690 4220 

91 

149 

14 

122 

78.37 

124.70 


(FT 15 FT 15) 











6 

White 

0.33 

0.67 

u 

1769 3370 

117 

122 

35 

78 

89.55 

155.25 


(FT 15 FT 15) 











7 

White 

0.67 

0.33 

u 

3482 2294 

123 

117 

77 

38 

138.25 

130.49 


(FT 15 FT 15) 











8 

White 

0.83 

0.17 

u 

11518 216 

190 

40 

158 

6 

244.42 

64.60 


(FT 15 FT 15) 











1 

Green 

0.17 

0.83 

s 

991 3128 

112 

128 

16 

no 

39.77 

277.22 


(FT 20 FT 10) 











2 

Green 

0.33 

0.67 

s 

1204 1764 

104 

116 

35 

74 

64.36 

236.55 


(FT 20 FT 10) 











3 

Green 

0.67 

0.33 

s 

2275 1690 

119 

121 

77 

43 

68.45 

151.42 


(FT 20 FT 10) 











4 

Green 

0.83 

0.17 

s 

2748 1656 

122 

118 

105 

22 

102.85 

134.42 


(FT 20 FT 10) 











5 

Green 

0.17 

0.83 

u 

243 4708 

44 

129 

10 

107 

71.25 

220.44 


(FT 20 FT 10) 











6 

Green 

0.33 

0.67 

u 

350 5967 

52 

187 

22 

130 

58.60 

356.66 


(FT 20 FT 10) 











7 

Green 

0.67 

0.33 

u 

1499 3672 

108 

132 

74 

43 

68.19 

316.09 


(FT 20 FT 10) 











8 

Green 

0.83 

0.17 

u 

3099 1284 

121 

107 

101 

21 

104.36 

163.91 


(FT 20 FT 10) 















Sig/ 








Condition 

1 Component 

/)(Left) 

T'(Right) 

Unsig 

Br Hr 



n. 

^R 

rt/. 

rtR 

186 1 

Red 

0.17 

0.83 

s 

2288 5065 

no 

123 

19 

103 

277.12 

170.41 


(FT 10 FT 20) 











2 

Red 

0.33 

0.67 

s 

7701 1328 

143 

94 

48 

63 

231.26 

152.32 


(FT 10 FT 20) 











3 

Red 

0.67 

0.33 

s 

9574 497 

164 

74 

109 

21 

236.68 

124.54 


(FT 10 FT 20) 











4 

Red 

0.83 

0.17 

s 

15532 106 

212 

25 

177 

4 

333.95 

89.00 


(FT 10 FT 20) 











5 

Red 

0.17 

0.83 

u 

2963 3264 

102 

99 

17 

82 

683.58 

139.55 


(FT 10 FT 20) 











6 

Red 

0.33 

0.67 

u 

5485 1336 

110 

97 

38 

62 

614.80 

192.39 


(FT 10 FT 20) 











7 

Red 

0.67 

0.33 

u 

8252 510 

141 

98 

93 

30 

632.81 

57.19 


(FT 10 FT 20) 











8 

Red 

0.83 

0.17 

u 

13938 25 

220 

16 

181 

0 

431.20 

50.50 


(FT 10 FT 20) 











1 

White 

0.17 

0.83 

s 

1179 5505 

84 

148 

22 

125 

186.03 

169.00 


(FT 15 FT 15) 











2 

White 

0.33 

0.67 

s 

1333 5819 

77 

158 

22 

108 

170.41 

148.55 


(FT 15 FT 15) 











3 

White 

0.67 

0.33 

s 

5010 2928 

122 

118 

80 

42 

209.76 

146.66 


(FT 15 FT 15) 











4 

White 

0.83 

0.17 

s 

7926 1177 

128 

105 

106 

17 

222.44 

142.56 


(FT 15 FT 15) 











5 

White 

0.17 

0.83 

u 

74 7956 

23 

210 

4 

174 

120.33 

113.73 


(FT 15 FT 15) 











6 

White 

0.33 

0.67 

u 

181 5978 

42 

166 

11 

111 

218.24 

181.33 


(FT 15 FT 15) 
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Independent Scheduling Group 


Condition 

1 Component 

/)(Left) 

/((Right) 

Unsig 

Bl Bn 


('R 

rR 

'^R 

rti. 

rtn 

7 

White 

0.67 

0.33 

u 

5222 2622 

117 

106 

76 

37 

447.33 

247.84 


(FT 15 FT 15) 











8 

White 

0.83 

0.17 

u 

10781 342 

163 

62 

136 

14 

321.89 

124.38 


(FT 15 FT 15) 











1 

Green 

0.17 

0.83 

s 

357 7417 

61 

171 

3 

141 

61.48 

238.23 


(FT 20 FT 10) 











2 

Green 

0.33 

0.67 

s 

432 7590 

44 

196 

13 

128 

96.05 

193.53 


(FT 20 FT 10) 











3 

Green 

0.67 

0.33 

s 

1154 5271 

81 

155 

55 

51 

173.20 

121.16 


(FT 20 FT 10) 











4 

Green 

0.83 

0.17 

s 

4504 3542 

116 

123 

98 

20 

141.81 

221.09 


(FT 20 FT 10) 











5 

Green 

0.17 

0.83 

u 

2711627 

2 

231 

1 

190 

15.00 

215.34 


(FT 20 FT 10) 











6 

Green 

0.33 

0.67 

u 

18 8065 

8 

187 

3 

127 

59.00 

399.51 


(FT 20 FT 10) 











7 

Green 

0.67 

0.33 

u 

4067 4001 

112 

114 

76 

40 

271.70 

603.22 


(FT 20 FT 10) 











8 

Green 

0.83 

0.17 

u 

4247 2542 

108 

115 

92 

20 

246.29 

278.36 


(FT 20 FT 10) 















Sig/ 








Condition 

1 Component 

/)(Left) /((Right) 

Unsig 

Bl Br 

Sl 

pr 

n. 

rR 

Hr 

rtR 

187 1 

Red 

0.17 

0.83 

s 

953 2208 

99 

120 

20 

99 

345.68 

599.60 


(FT 10 FT 20) 











2 

Red 

0.33 

0.67 

s 

1908 1634 

102 

100 

37 

67 

556.61 

216.30 


(FT 10 FT 20) 











3 

Red 

0.67 

0.33 

s 

4056 284 

134 

77 

85 

22 

613.22 

74.59 


(FT 10 FT 20) 











4 

Red 

0.83 

0.17 

s 

3389 55 

119 

25 

97 

6 

529.78 

98.45 


(FT 10 FT 20) 











5 

Red 

0.17 

0.83 

u 

1106 2026 

no 

122 

17 

99 

424.32 

273.78 


(FT 10 FT 20) 











6 

Red 

0.33 

0.67 

u 

2876 755 

132 

105 

43 

71 

330.45 

54.70 


(FT 10 FT 20) 











7 

Red 

0.67 

0.33 

u 

4984 311 

144 

92 

102 

24 

264.99 

34.54 


(FT 10 FT 20) 











8 

Red 

0.83 

0.17 

u 

7173 78 

184 

31 

160 

0 

924.16 

45.00 


(FT 10 FT 20) 











1 

White 

0.17 

0.83 

s 

1359 2647 

98 

110 

12 

95 

188.09 

897.01 


(FT 15 FT 15) 











2 

White 

0.33 

0.67 

s 

1349 2540 

102 

115 

28 

80 

330.66 

736.88 


(FT 15 FT 15) 











3 

White 

0.67 

0.33 

s 

3826 882 

130 

99 

89 

34 

461.17 

308.09 


(FT 15 FT 15) 











4 

White 

0.83 

0.17 

s 

2105 15 

93 

9 

80 

1 

335.50 

29.20 


(FT 15 FT 15) 











5 

White 

0.17 

0.83 

u 

294 3665 

84 

141 

19 

123 

158.47 

863.18 


(FT 15 FT 15) 











6 

White 

0.33 

0.67 

u 

1077 1271 

105 

101 

35 

61 

143.28 

194.21 


(FT 15 FT 15) 











7 

White 

0.67 

0.33 

u 

2305 637 

98 

82 

66 

26 

107.65 

81.48 


(FT 15 FT 15) 











8 

White 

0.83 

0.17 

u 

4828 205 

151 

58 

122 

11 

256.28 

71.50 


(FT 15 FT 15) 











1 

Green 

0.17 

0.83 

s 

704 2527 

84 

100 

17 

82 

196.31 

894.16 


(FT 20 FT 10) 











2 

Green 

0.33 

0.67 

s 

384 2668 

84 

109 

28 

71 

135.97 

896.99 


(FT 20 FT 10) 
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Independent Scheduling Group 


Condition 

Component 

^(Left) 

^(Right) 

Unsig 

Bj. 

Br 


PR 


rR 

rtL 

rtR 

3 

Green 

(FT 20 FT 10) 

0.67 

0.33 

s 

1254 2415 

98 

103 

65 

33 

215.62 

375.84 

4 

Green 

(FT 20 FT 10) 

0.83 

0.17 

s 

2598 

8 

194 

5 

160 

0 

342.28 

18.00 

5 

Green 

(FT 20 FT 10) 

0.17 

0.83 

u 

50 5613 

34 

181 

6 

148 

62.75 

1079.35 

6 

Green 

(FT 20 FT 10) 

0.33 

0.67 

u 

694 2202 

112 

128 

38 

87 

72.68 

425.34 

7 

Green 

(FT 20 FT 10) 

0.67 

0.33 

u 

1316 1250 

107 

109 

67 

42 

82.34 

317.55 

8 

Green 

0.83 

0.17 

u 

3916 166 

161 

60 

130 

12 

134.23 

143.12 


(FT 20 FT 10) 

Sig/ 

Condition Component ^(Left) ^(Right) Unsig Br e^ e.R rj^ yr rtj^ yIr 


1 

Red 




0.17 

0.83 

S 

3304 

1420 

105 

96 

15 

78 

280.63 

132.54 


(FT 

10 

FT 

20) 












2 

Red 




0.33 

0.67 

S 

3933 

1334 

124 

116 

41 

76 

322.54 

163.42 


(FT 

10 

FT 

20) 












3 

Red 




0.67 

0.33 

S 

8208 

134.5180 

43 

122 

10 

431.73 

53.03 


(FT 

10 

FT 

20) 












4 

Red 




0.83 

0.17 

S 

8820 

8 

191 

4 

158 

0 

731.03 

10.50 


(FT 

10 

FT 

20) 












5 

Red 




0.17 

0.83 

U 

1289 

1588 

88 

99 

14 

81 

438.63 

283.56 


(FT 

10 

FT 

20) 












6 

Red 




0.33 

0.67 

U 

1981 

1017 

95 

85 

36 

56 

495.40 

179.56 


(FT 

10 

FT 

20) 












7 

Red 




0.67 

0.33 

u 

5495 

120 

145 

57 

97 

18 

886.45 

74.27 


(FT 

10 

FT 

20) 












8 

Red 




0.83 

0.17 

u 

5042 

98 

144 

46 

125 

6 

710.99 

49.98 


(FT 

10 

FT 

20) 












1 

White 




0.17 

0.83 

s 

1779 

2968 

106 

117 

22 

101 

188.83 

293.47 


(FT 

15 

FT 

15) 












2 

White 




0.33 

0.67 

s 

1729 

2668 

103 

111 

36 

75 

167.32 

296.54 


(FT 

15 

FT 

15) 












3 

White 




0.67 

0.33 

s 

3702 

1507 

114 

no 

73 

37 

252.31 

157.69 


(FT 

15 

FT 

15) 












4 

White 




0.83 

0.17 

s 

7580 

215 

145 

71 

124 

13 

319.24 

107.13 


(FT 

15 

FT 

15) 












5 

White 




0.17 

0.83 

u 

277 

3889 

66 

150 

10 

125 

124.84 

531.54 


(FT 

15 

FT 

15) 












6 

White 




0.33 

0.67 

u 

1195 

2018 

91 

103 

33 

68 

170.58 

328.31 


(FT 

15 

FT 

15) 












7 

White 




0.67 

0.33 

u 

2592 

1081 

115 

115 

75 

37 

513.86 

277.13 


(FT 

15 

FT 

15) 












8 

White 




0.83 

0.17 

u 

4239 

223 

146 

80 

120 

11 

567.63 

119.24 


(FT 

15 

FT 

15) 












1 

Green 




0.17 

0.83 

s 

597 

4565 

87 

136 

13 

111 

83.44 

464.86 


(FT 

20 

FT 

10) 












2 

Green 




0.33 

0.67 

s 

1570 

3223 

111 

125 

38 

81 

108.15 

534.49 


(FT 

20 

FT 

10) 












3 

Green 




0.67 

0.33 

s 

2219 

1972 

98 

96 

66 

34 

172.26 

277.56 


(FT 

20 

FT 

10) 












4 

Green 




0.83 

0.17 

s 

5949 

288 

134 

77 

108 

9 

225.94 

158.67 


(FT 

20 

FT 

10) 












5 

Green 




0.17 

0.83 

u 

33 

4344 

20 

141 

4 

118 

31.20 

746.10 


(FT 

20 

FT 

10) 
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Independent Scheduling Group 
Condition Component 

^(Left) 

/;(Right) 

Sig/ 

Unsig 

5/. Bn 





rtL 

rtn 

6 

Green 

(FT 20 FT 10) 

0.33 

0.67 

u 

63 3770 

28 

126 

5 

84 

85.30 

432.36 

7 

Green 

(FT 20 FT 10) 

0.67 

0.33 

u 

1054 1530 

98 

101 

63 

35 

356.81 

604.96 

8 

Green 

(FT 20 FT 10) 

0.83 

0.17 

u 

2583 303 

131 

81 

108 

18 

334.70 

332.79 


